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Program description JOBSTART is an alternative education and training program 

designed to improve the economic prospects of young, 
disadvantaged high school dropouts by increasing educational 
attainment and developing occupational skills. The program has 
four main components: (1) basic academic skills instruction with 



a focus on GED (General Educational Development) preparation, 
(2) occupational skills training, (3) training-related support ser- 
vices (such as transportation assistance and childcare), and (4) 
job placement assistance. Participants receive at least 200 hours 
of basic education and 500 hours of occupational training. 1 



Research One study of JOBSTART met What Works Clearinghouse (WWC) 
evidence standards. This randomized controlled trial included 
more than 2,300 youth and was conducted in 13 sites in nine 
states: Arizona, California, Colorado, Connecticut, Illinois, 
Georgia, New York, Pennsylvania, and Texas. Based on this one 
study, the WWC considers the extent of evidence for JOBSTART 



to be small for completing school (see the What Works Clear- 
inghouse Extent of Evidence Categorization Scheme) . The one 

JOBSTART study that met WWC evidence standards did not 
examine the effectiveness of JOBSTART in the domains of stay- 
ing or progressing in school. 2 



Effectiveness JOBSTART was found to have potentially positive effects on completing school. 





Staying in school 


Progressing in school 


Completing school 


Rating of effectiveness 


na 


na 


Potentially positive effects 


Improvement index 3 


na 


na 


Average: +14 percentile points 








na = not applicable 



1. The WWC dropout prevention review includes interventions designed to encourage students who drop out to return to school and earn a high school 
diploma or GED certificate, as well as interventions designed to prevent initially enrolled students from dropping out. For more details, see the WWC 

dropout prevention review protocol . 

2. The evidence in this report is based on available research. Findings and conclusions may change as new research becomes available. 

3. These numbers show the average improvement indices for all findings across the study. 
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Developer and contact 

JOBSTART, no longer an active program, has no current avail- 
able developer or contact information. JOBSTART was devel- 
oped and evaluated by MDRC as a nonresidential alternative 
to Job Corps. Using Job Training Partnership Act funds, local 
institutions ran the JOBSTART programs. Additional information 
about the program model and the implementation experience 
of the organizations that used it can be found in Auspos, Cave, 
Doolittle, and Hoerz (1989) listed in the “References” for this 
report. 

Scope of use 

The JOBSTART demonstration operated in 13 sites in nine states 
from 1985 to 1988. Of the 13 study sites, 3 were adult vocational 
schools, 1 was a community college, 6 were community-based 
organizations, and 6 were nonresidential Job Corps programs. 
Sites were selected because of their experience running 
programs that included some or all of the components in the 
JOBSTART model. JOBSTART was run as part of a research 
demonstration, and it ended when the evaluation was com- 
pleted. Although the program has ended, the core components— 
education and occupational skills training with support services 
to facilitate participation— are shared with many programs for 
school dropouts and disadvantaged youth still operating, such 
as youth programs funded through the Workforce Investment Act 
and Job Corps, on which JOBSTART was modeled. 



Description of intervention 

JOBSTART aims to improve the employment and earnings 
potential of high school dropouts through basic education, job 
training, and support services. The program serves youth who 
are 17 to 21 years old, have dropped out of school, read below 
an 8th-grade level, and meet one of the following three criteria: 
(1) receive public assistance, (2) have family income at or below 
the poverty line, or (3) are homeless. Participation in JOBSTART 
is voluntary. The program offers both basic education and 
occupational skills training. The education component improves 
participants’ basic academic skills to prepare them to obtain a 
GED certificate and begin occupational skills training. Partici- 
pants complete workbook exercises in reading, math, and other 
subjects included on the GED test. Exercises are self-paced, 
and participants receive individualized instruction from program 
teachers. As part of the occupational training component of 
JOBSTART, youth select and attend vocational skills courses 
that offer training for specific occupations. JOBSTART also 
offers support services, such as childcare and transportation 
assistance, to facilitate participation. Once participants have 
completed their education and training, JOBSTART offers par- 
ticipants job placement assistance. 

Cost 

Based on data available from the study, the WWC estimates that 
the average cost of JOBSTART is about $9,700 per participant. 4 



The WWC reviewed one study of the effectiveness of JOBSTART. 
This study (Cave, Bos, Doolittle, &Toussaint, 1993) was a ran- 
domized controlled trial that met WWC evidence standards. 

Cave, Bos, Doolittle, and Toussaint (1993) examined the 
effectiveness of JOBSTART in 13 sites in nine states. From 
1985 to 1987, 2,312 eligible youth who applied for JOBSTART 



services across these 13 sites were randomly assigned: 1,163 to 
the intervention group that was offered JOBSTART services and 
1,149 to the control group that was not. The results summarized 
here are based on data for the 988 JOBSTART youth and the 
953 control group youth who responded to the 48-month follow- 
up survey. 



4. Cave, Bos, Doolittle, and Toussaint (1993) report that the average cost per sample member randomly assigned to the program was $4,548 in 1988 dol- 
lars. The WWC converted this estimate to 2007 dollars using the consumer price index and then divided this figure by 0.888, the proportion of sample 
members in the program group who received any JOBSTART services. 
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Extent of evidence 

The WWC categorizes the extent of evidence in each domain as 
small or moderate to large (see the What Works Clearinghouse 
Extent of Evidence Categorization Scheme) . The extent of 
evidence takes into account the number of studies and the total 
sample size across studies that met WWC evidence standards 



with or without reservations. 5 

The WWC considers the extent of evidence for JOBSTART 
to be small for completing school. No studies that met WWC 
evidence standards addressed JOBSTART’s effect on staying in 
school or progressing in school. 



Findings 

The WWC review of interventions for dropout prevention 
addresses student outcomes in three domains: staying in school, 
progressing in school, and completing school. The JOBSTART 
study by Cave et al. examined outcomes in the completing 
school domain. 

Completing school. The study showed a statistically significant 
difference between JOBSTART and control group youth on the 
likelihood of receiving a high school diploma or GED certificate. 
Four years after random assignment, 42% of JOBSTART youth 
had earned a high school diploma or GED certificate, compared 
with 29% of control group youth. This positive effect on comple- 
tion came entirely from JOBSTART’s positive and statistically 



significant effect on receiving a GED certificate. JOBSTART was 
found to have a small, but statistically significant, negative effect 
on the likelihood of earning a high school diploma. 6 

Rating of effectiveness 

The WWC rates the effects of an intervention in a given outcome 
domain as: positive, potentially positive, mixed, no discernible 
effects, potentially negative, or negative. The rating of effective- 
ness takes into account four factors: the quality of the research 
design, the statistical significance of the findings, the size of 
the difference between participants in the intervention and the 
comparison conditions, and the consistency in findings across 
studies (see the WWC Intervention Rating Scheme) . 7 



Improvement index 

The WWC computes an improvement index for each individual 
finding. In addition, within each outcome domain, the WWC 
computes an average improvement index for each study as well 
as an average improvement index across studies (see Technical 
Details of WWC-Conducted Computations) . The improvement 



index represents the difference between the percentile rank of 
the average student in the intervention condition and that of the 
average student in the comparison condition. Unlike the rating 
of effectiveness, the improvement index is based entirely on the 
size of the effect, regardless of the statistical significance of the 
effect, the study design, or the analyses. The improvement index 



5. The Extent of Evidence Categorization was developed to tell readers how much evidence was used to determine the intervention rating, focusing on the 
number and size of studies. Additional factors associated with a related concept, external validity— such as students' demographics and types of set- 
tings in which studies took place— are not taken into account for the categorization. Information about how the extent of evidence rating was determined 
for JOBSTART is in Appendix A6. 

6. As in other WWC dropout prevention reviews, the combined effect of JOBSTART on receiving a high school diploma or GED certificate was used to 
determine the effectiveness rating. These results are in Appendix A3. The separate effects of JOBSTART on receiving a high school diploma or GED 
certificate are in Appendix A4.2. At the end of the follow-up period, the percentage of youth who earned a high school diploma was small for both 
JOBSTART and control group youth, 4.4% and 7.5% respectively. 

7. The level of statistical significance was reported by the study authors, or where necessary, calculated by the WWC to correct for clustering within 
classrooms or schools and for multiple comparisons. For an explanation, see the WWC Tutorial on Mismatch . For the formulas the WWC used to cal- 
culate statistical significance, see Technical Details of WWC-Conducted Computations . For Cave et al. (1993), no corrections for clustering or multiple 
comparisons were needed. 
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The WWC found JOBSTART 
to have potentially positive 
effects on completing 
school (continued) 


can take on values between -50 and +50, with positive numbers 
denoting results favorable to the intervention group. 

Based on the one study of JOBSTART that met evidence 
standards, the average improvement index for completing school 
is +14 percentile points. 


Summary 

The WWC reviewed one study of the effectiveness of JOBSTART. 
This study met WWC evidence standards. Based on the results 
from the one qualifying study, the WWC found potentially posi- 
tive effects on completing school. The conclusions presented in 
this report may change as new research emerges. 


References 


Met WWC evidence standards 

Cave, G., Bos, H., Doolittle, F., &Toussaint, C. (1993). JOBSTART: 
Final report on a program for school dropouts. New York, NY: 
MDRC. 

Additional sources 

Auspos, P., Cave, G., Doolittle, F., & Floerz, G. (1989). Imple- 
menting JOBSTART: A demonstration for school dropouts 
in the JTPA system. New York, NY: MDRC. 


Cave, G., & Doolittle, F. (1991). Assessing JOBSTART: Interim 
impacts of a program for school dropouts. New York, NY: 
MDRC. 



For more information about specific studies and WWC calculations, please see the WWC JOBSTAR T Technical 
Appendices . 
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Appendix A1 


Study Characteristics: Cave, Bos, Doolittle, & Toussaint, 1993 (randomized controlled trial) 


Characteristic 


Description 


Study citations 


Cave, G., Bos, H., Doolittle, F., & Toussaint, C. (1993). JOBSTART: Final report on a program for school dropouts. New York, NY: MDRC. 


Participants 


JOBSTART served youth who were: (1) 17 to 21 years old, (2) lacking a high school diploma or GED certificate, (3) reading below an 8th-grade level, and (4) economically dis- 
advantaged. To meet enrollment targets, sites could waive the poor-reading-skills criterion for 20% of their enrollees. Applicants were considered economically disadvantaged 
if they: (1) received public assistance, (2) had a family income at or below the poverty line, or (3) were homeless. 

From 1985 to 1987, JOBSTART participants were recruited and enrolled by 13 sites in nine states. All participants were high school dropouts, and half had not worked at all in 
the year prior to enrolling in the program. Most JOBSTART recruits were non-White, 44% African-American, and 44% Hispanic. Just over half enrollees (54%) were women, 
and about half the women were young mothers. At baseline, 27% of sample members were receiving Aid to Families with Dependent Children or general assistance, while 
38% were receiving food stamps. 

In the JOBSTART demonstration, 2,312 youth were randomly assigned to either JOBSTART or a control condition. The analyses in this report are based on data collected in 
the 48-month follow-up survey, to which 85% of JOBSTARTyouVn and 83% of control group youth responded. Among the 1,941 respondents, the study authors compared 
the baseline characteristics of JOBSTART and control group youth, including their gender, ethnicity, family structure, employment history, and whether they received public 
assistance. They found no statistically significant differences between the research groups on these characteristics. 


Setting 


JOBSTARTms evaluated in 13 study sites in nine states: Arizona (Phoenix), California (Fos Angeles, Monterey Park, San Jose), Colorado (Denver), Connecticut (Hartford), 
Illinois (Chicago), Georgia (Atlanta), New York (Buffalo, New York City), Pennsylvania (Pittsburgh), and Texas (Corpus Christi, Dallas). The sites differed in their organization and 
structure: four of the sites were adult schools (three vocational, one community college), six were community-based organizations, and three were nonresidential Job Corps 
programs. 




(continued) 
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Appendix A1 Study Characteristics: Cave, Bos, Doolittle, & Toussaint, 1993 (randomized controlled trial) (continued) 



Characteristic Description 

Intervention JOBSTART offered a combination of education and occupational preparation services to improve the employment prospects of high school dropouts. Participation was volun- 

tary. JOBSTART was modeled after Job Corps, which according to the study authors, was one of the few programs that had documented success in improving the outcomes of 
high school dropouts. But Job Corps was relatively expensive and required a residential commitment (a considerable barrier to participation for many youth). JOBSTART offered 
many of the same components as Job Corps, but was nonresidential. In addition, in an effort to reduce the program cost, JOBSTART did not include some of Job Corps' most 
intensive services, such as extensive support services, paid work experience, and financial compensation. 

JOBSTART emphasized education and occupational preparation. It had four key components: (1) instruction in basic academic skills, (2) occupational skills training, (3) support 
services to facilitate participation, and (4) job placement assistance. Although all sites were required to offer the four components, implementation of the components varied. 
Some sites, for instance, offered all components in-house, while others linked participants with outside agencies that provided these services. The four key components of 
JOBSTART are described in more detail below: 

1 . Instruction in basic academic skills. Sites offered participants a minimum of 200 hours of self-paced instruction on reading, math, and other subjects covered on the 
GED test. Sites were not required to use a particular curriculum or materials. During basic academic skills classes, participants worked on exercises using workbooks or, 
less commonly, computer-assisted instruction. Teachers reviewed their progress and provided individualized instruction. Sites had flexibility in how they implemented this 
component of JOBSTART. For example, some sites offered group instruction, while others did not. Sites also selected the curricula and the number of hours per week that 
were focused on basic skills. Typically, basic academic skills classes met two to three hours per day three to five days per week. According to study authors, JOBSTART 
youth spent, on average, 125 hours in the program’s basic academic skills classes (Cave et al., 1993). This average includes the 11% of youth who were assigned to 
JOBSTARTbut did not participate in the program. 

2. Occupational skills training. Sites offered participants a minimum of 500 hours of occupational skills training. Occupational skills instruction was classroom based and 
designed to prepare youth for high-demand occupations. Classes met three to four hours a day, three to five days a week. In 8 of the 13 sites, occupational skills training 
was offered concurrently with basic academic skills instruction. In the other sites, participants received occupational skills training after completing their basic academic 
skills instruction. Sites were instructed to develop training materials with the assistance of private-sector partners to meet the entry-level requirements of local employ- 
ers. Sites developed courses to cover a range of occupations, including clerical and service jobs, machine trades, and other skilled trades. According to study authors, 
JOBSTART youth completed, on average, 238 hours of occupational skills instruction (Cave et al., 1993). This average includes the 11% of youth who were assigned to 
JOBSTART but did not participate in the program. 

3. Support services. To facilitate participation in the program, JOBSTART offered transportation and child care assistance. Transportation assistance could take the form of 
bus passes or small allowances. Child care was mainly provided by other agencies off-site, with JOBSTART covering the costs. Most sites also offered participants small 
amounts of money for emergencies (to cover the cost of rent or clothing, for example), as well as on-site meals. About half the sites offered life-skills training on such 
topics as health, personal finances, and workplace expectations. 

4. Job placement assistance. Sites assisted participants in finding jobs upon completing JOBSTART’ s education and occupational skills components. Most sites offered 
participants instruction in employers' expectations and job search techniques. About half the sites arranged internships with employers for participants. Assistance 
in finding permanent employment was often not offered until participants completed the program's education and occupational skills components. Because many 
participants dropped out of JOBSTART before completing the education and skills training, many did not receive help with job placement. On follow-up surveys, only 
one-quarter of JOBSTART participants reported that staff had informed them of job openings and opportunities. 



(continued) 
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Appendix A1 Study Characteristics: Cave, Bos, Doolittle, & Toussaint, 1993 (randomized controlled trial) (continued) 



Characteristic 


Description 


Comparison 


Control group youth were not eligible to participate in JOBSTART but could voluntarily participate in other services available in the community. Based on survey responses, 
many control group youth participated in education and training programs during the follow-up period — but their rate of participation was substantially lower than it was 
among JOBSTART youth (Cave et at, 1993). During the four years after random assignment, 56% of control group youth reported receiving remedial or occupational 
instruction, compared with 94% of JOBSTART youth. Over this period, the average amount of participation in education and training was 432 hours for control group youth, 
compared with 800 hours for the JOBSTART youth (including their participation in JOBSTART as well as other education and training activities). 


Primary outcomes 
and measurement 


One relevant outcome from the JOBSTART study is included in this summary and used for rating purposes: receiving a high school diploma or GED certificate within 48 
months of random assignment. For a more detailed description of the outcome measure, see Appendix A2. The study also examined the program's effects on employment, 
hours worked, total earnings, welfare receipt, pregnancy, criminal activity, and drug use. These outcomes, however, do not fall within the three domains examined by the 
WWC’s review of dropout prevention interventions (staying in school, progressing in school, and completing school). So, they are not included in this report. 


Staff training 


Many JOBSTART staff were former teachers from public schools or community colleges. In many instances, these teachers had experience working with disadvantaged youth 
or adults. In some instances, they had taught GED preparation classes or remedial education prior to working for JOBSTART. Other JOBSTART staff had previously worked in 
other employment programs for disadvantaged youth (Auspos, Cave, Doolittle, & Hoerz, 1989). 
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Appendix A2 Outcome measures for the completing school domain 



Outcome measure 


Description 


Earned a high school 
diploma or GED certificate 
within 48 months of 
random assignment 


This binary measure represents the percentage of students who either received a high school diploma or GED certificate within 48 months of random assignment. This 
measure was based on the sample member's response to the 48-month survey. 
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Appendix A3 Summary of study findings included in the rating for the completing school domain 1 









Authors’ findings from the study 














Mean outcome 




WWC calculations 












Mean difference 2 


Statistical 






Study 


Sample size 


JOBSTART Comparison 


( JOBSTART - 


significance 4 


Improvement 


Outcome measure 


sample 


(students) 


group group 


comparison) 


Effect size 3 (at a = 0.05) 


index 5 





Cave, Bos, Doolittle, & Toussaint, 1993 (randomized controlled trial) 6 








Earned a high school diploma or Full sample 

GED certificate within 48 months 
of random assignment (%) 


1,941 42.0 28.6 13.4 


0.36 


Statistically 

significant 


+14 


Domain average for completing school 7 




0.36 


Statistically 

significant 


+14 



1 . This appendix reports findings considered for the effectiveness rating and the average improvement index for the completing school domain. Subgroup findings are not included in these ratings but are in Appendix A4.1 . Appendix A4.2 
reports the separate effects of JOBSTART on earning a GED certificate or high school diploma, which were not used in JOBSTART's effectiveness rating. 

2. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

3. Effect sizes for dichotomous variables were computed using the Cox Index. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

4. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between groups. 

5. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and the average student in the comparison condition. The improvement index can take on values be- 
tween -50 and +50, with positive numbers denoting results favorable to the intervention group. 

6. The level of statistical significance was reported by the study authors, or where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the clus- 
tering correction, see the WWC Tutorial on Mismatch . For the formulas the WWC used to calculate statistical significance, see Technical Details of WWC-Conducted Computations . In this case, no corrections for clustering or multiple 
comparisons were needed. 

7. The domain improvement index is calculated from the average effect size. 
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Appendix A4.1 Summary of subgroup findings by gender and parenthood status for the completing school domain 1 









Authors’ findings from the study 














Mean outcome 




WWC calculations 












Mean difference 2 


Statistical 






Study 


Sample size 


JOBSTART Comparison 


(JOBSTART- 


significance 4 


Improvement 


Outcome measure 


sample 


(students) 


group group 


comparison) 


Effect size 3 (at a = 0.05) 


index 5 







Cave, Bos, Doolittle, & Toussaint, 1993 (randomized controlled trial) 6 








Earned a high school diploma or 
GED certificate within 48 months 
of random assignment (%) 


Men 


900 


42.0 


28.3 


13.7 


0.37 


Statistically 

significant 


+14 


Earned a high school diploma or 
GED certificate within 48 months 
of random assignment (%) 


Women living with 
own children at 
baseline 


508 


42.0 


26.7 


15.3 


0.42 


Statistically 

significant 


+16 


Earned a high school diploma or 
GED certificate within 48 months 
of random assignment (%) 


Women not living 
with own children 
at baseline 


533 


41.6 


31.3 


10.4 


0.27 


Statistically 

significant 


+11 



1 . This appendix presents subgroup findings by gender and parenthood status for the intervention's effects on receiving a high school diploma or GED certificate. The full sample was used for determining the effectiveness rating. These 
findings are in Appendix A3. 

2. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

3. Effect sizes for dichotomous variables were computed using the Cox Index. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

4. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between groups. 

5. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and the average student in the comparison condition. The improvement index can take on values be- 
tween -50 and +50, with positive numbers denoting results favorable to the intervention group. 

6. The level of statistical significance was reported by the study authors, or where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the clus- 
tering correction, see the WWC Tutorial on Mismatch . For the formulas the WWC used to calculate statistical significance, see Technical Details of WWC-Conducted Computations . In this case, no corrections for clustering or multiple 
comparisons were needed. 
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Appendix A4.2 Summary of additional findings for the completing school domain 1 









Authors’ findings from the study 














Mean outcome 




WWC calculations 












Mean difference 2 


Statistical 






Study 


Sample size 


JOBSTART Comparison 


( JOBSTART - 


significance 4 


Improvement 


Outcome measure 


sample 


(students) 


group group 


comparison) 


Effect size 3 (at a = 0.05) 


index 5 



Earned a GED certificate Full sample 

within 48 months of 
random assignment (%) 

Earned a high school diploma Full sample 

within 48 months of random 
assignment (%) 7 



Cave, Bos, Doolittle, & Toussaint, 1993 (randomized controlled trial) 6 

1,941 37.6 21.1 16.5 0.49 



1,941 



4.4 



7.5 



-3.1 



-0.34 



Statistically 

significant 

Statistically 

significant 



+19 



-13 



1 . This appendix presents separate effects of JOBSTART on receiving a high school diploma or GED certificate. The intervention's combined effect on receiving a high school diploma or GED certificate was used for determining the ef- 
fectiveness rating and is in Appendix A3. 

2. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

3. Effect sizes for dichotomous variables were computed using the Cox Index. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

4. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between groups. 

5. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and the average student in the comparison condition. The improvement index can take on values be- 
tween -50 and +50, with positive numbers denoting results favorable to the intervention group. 

6. The level of statistical significance was reported by the study authors, or where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the clus- 
tering correction, see the WWC Tutorial on Mismatch . For the formulas the WWC used to calculate statistical significance, see Technical Details of WWC-Conducted Computations . In this case, no corrections for clustering or multiple 
comparisons were needed. 

7. These results were calculated by the WWC using the means and sample sizes reported in Cave et al. (1993). 
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Appendix A5 JOBSTART rating for the completing school domain 



The WWC rates an intervention’s effects in a given outcome domain as positive, potentially positive, mixed, no discernible effects, potentially negative, or negative. 1 

For the outcome domain of completing school, the WWC rated JOBSTART as having potentially positive effects. It did not meet the criteria for positive effects 
because only one study showed a statistically significant or substantively important effect in this domain. The remaining ratings (mixed effects, no discernable effects, 
potentially negative effects, negative effects) were not considered because JOBSTART was assigned the highest applicable rating. 

Rating received 

Potentially positive effects: Evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: At least one study showing a statistically significant or substantively important positive effect. 

Met. One study of JOBSTART meeting WWC evidence standards found a statistically significant effect in this domain. 

AND 

• Criterion 2: No studies showing a statistically significant or substantively important negative effect and fewer or the same number of studies showing indeterminate 
effects than showing statistically significant or substantively important positive effects. 

Met. No study of JOBSTART found statistically significant or substantively important negative effects in the completing school domain. 

Other ratings considered 

Positive effects: Strong evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statistically significant positive effects, at least one of which met WWC evidence standards for a strong design. 

Not met. JOBSTART had only one study that met WWC evidence standards. 

AND 

• Criterion 2: No studies showing statistically significant or substantively important negative effects. 

Met. No study found statistically significant or substantively important negative effects in this domain. 

1. For rating purposes, the WWC considers the statistical significance of individual outcomes and the domain-level effect. The WWC also considers the size of the domain-level effect for ratings of 
potentially positive or potentially negative effects. For a complete description, see the WWC Intervention Rating Scheme . 
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Appendix A6 Extent of evidence by domain 



Outcome domain 


Number of studies 


Schools 


Sample size 

Students 


Extent of evidence 1 


Staying in school 


0 


na 


na 


na 


Progressing in school 


0 


na 


na 


na 


Completing school 


1 


13 


1,941 


Small 



na = not applicable/not studied 

1. A rating of “moderate to large” requires at least two studies and two schools across studies in one domain and a total sample size across studies of at least 350 students or 14 classrooms. 
Otherwise, the rating is “small.” 
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